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Abstract 

In this paper, the consensus problems of the continuous-time integrator systems under noisy mea- 
surements are considered. The measurement noises, which appear when agents measure their neighbors' 
states, are modeled to be multiplicative. By multiplication of the noises, here, the noise intensities are 
proportional to the absolute value of the relative states of agent and its neighbor. By using known 
distributed protocols for integrator agent systems, the closed-loop system is described in the vector form 
by a singular stochastic differential equation. For the fixed and switching network topologies cases, con- 
stant consensus gains are properly selected, such that mean square consensus and strong consensus can 
be achieved. Especially, exponential mean square convergence of agents' states to the common value 
is derived for the fixed topology case. In addition, asymptotic unbiased mean square average consen- 
sus and asymptotic unbiased strong average consensus are also studied. Simulations shed light on the 
effectiveness of the proposed theoretical results. 

1 Introduction 

Recently, distributed coordination of multi-agent systems has attracted more and more attention of multi- 
disciplinary researchers, due to its wide applications in cooperative control, formation control and distributed 
optimization, and flocking problem. Most of all, the consensus problem is one of the fundamental topics in 
distributed coordination. By consensus, the group of dynamic agents will asymptotically reach an agreement 
on certain quantity of interest. For the distributed control problem, this means that by designing a distributed 
protocol such that the states of each agent asymptotically reach the agreement. This is the core topic of this 
paper. 

The research efforts of consensus problem in the system and control community can be traced back to the 
work [30], which deals with the asynchronous consensus problems with application to distributed decision- 
making systems. Much recent works in this area are motivated by the Vicsck's model [31]. In [31], Vicsec 
et al. propose a nearest neighbor rule that updates the heading of the autonomous agents moving in the 
plane with the same speed but with different headings, and provide simulation results which demonstrate 
that the nearest neighbor rule can cause all agents to eventually move in the same direction. For the Vicsek 
model, its analytic behavior is subsequently studied in [12], which provides a theoretical explanation for the 
observed behavior. Another exact formulation in population of autonomous agents is achieved by [4]. The 
cardinal feature of the model in [4] is that the interaction between any pair of the agents is a well defined 
nonlinear function of the difference between their co-ordinates in R'^. Since then, lots of literatures about 
this area appear, and readers may refer to, for example, [2, 20, 21, 23, 24, 25, 35], and to [22, 26, 32] for 
recent survey. 
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In reality, communication processes are always corrupted by various uncertain factors, such as random 
link failures, transmission noises and quantization errors. These are outcomes of the use of sensors, quanti- 
zation and wireless fading channels in the network. Recently, the consensus problems that concern corrupted 
communication processes between agents have attracted many researchers. In [9], the authors model the 
measurement noises to be additive, which means that the noises additively input the communication pro- 
cesses. To attenuate this type of measurement noises, a decreasing consensus gain is designed to reduce the 
detrimental effect of the noises. For fixed network topology, mean square consensus and strong consensus 
results are presented. Furthermore, in [10], the authors deal with randomly varying topology, while [11] 
considers the Markovian and arbitrary switching topologies. In [15], the authors consider continuous time 
first-order integrator model with Gaussian additive standard white noise. To be exact, in [15], firstly, for 
noise-free cases, necessary and sufficient conditions are given on the network topology and consensus gains 
to achieve average-consensus; secondly, for the cases with measurement noises, necessary and sufficient con- 
ditions are given on the consensus gains to achieve asymptotic unbiased mean square average-consensus. In 
addition, [16] considers the time-varying topology case, while [19] deals with the leader- follower consensus 
control problem. It is worth noting that most existing literatures are for additive measurement noises. 

In this paper, we model the measurement noises to be multiplicative, which may be viewed as the 
complement to those considered in [9, 15, 19]. Our modelling comes from a simple intuition. To be exact, 
as the states of agents (say, for example, mobile vehicles) may be viewed as the positions, intuitively, the 
closer the vehicles are to each other, the smaller the intensities of measurement noises should be related to 
them. In fact, the idea that takes into account the relative states has been already proposed by Cucker and 
Smale in [4], which is called an exact formulation by Vicsek [32]. In [4], elements of the adjacency matrix 
are modeled as non-increasing functions of the distance between agents to measure the ability of agents 
communication with each other. This means that the closer the agents are to each other, the bigger the 
influences is among them. Furthermore, many interesting extensions of Cucker-Smale model are developed; 
see, for example, [3, 5, 8, 32]. On the other hand, multiplicative noises often appear in communication 
process modelling, especially for the cases of fading communication channel; see, for example, [7, 13, 27, 33]. 
Therefore, in this paper, to describe the influence of relative states on the communication ability between 
agents under the noisy environment, we model the intensities of measurement noises to be proportional to 
the distance between agents. Clearly, our model may be viewed as a variant of Cucker-Smale model in the 
case of noisy environment, and the noises are multiplicative in the way of depending on the agents' relative 
states. Furthermore, the measurement noises will disappear when states of two agents coincide; in other 
words, agents' states can be measured precisely by agents themselves, which is the case of most existing 
literatures. 

In this paper, we consider consensus problems for continuous-time first-order integrator system. The 
major difference between this paper and existing literatures is that the measurement model is different. 
This results in that the closed-loop system is a singular stochastic differential equation (SDE) under the 
known protocol. Here, by singularity of SDE, we mean that the covariance matrix of the system noise is 
allowed to be degenerate. This is different from the non-degenerate SDE arising in existing literatures due to 
the additivity of the measurement noises. Intuitively, if we can design a mean square (strong, respectively) 
protocol, and when time t is large enough, the scales of measurement noises will be very small. Therefore, the 
decreasing consensus gain is not necessary. In fact, methodology developed here is related to the stability of 
equilibrium point of linear stochastic systems with multiplicative noises [1, 6, 37, 38]. This paper considers 
two cases of network topology. For the case of fixed network topology, a constant consensus gain is selected 
to ensure the mean square consensus and strong consensus, respectively. Especially, exponential mean square 
convergence of agents' states to the common value is derived. For the case of switching network topology, 
a consensus gain is also designed. If all the possible digraphs are balanced and the union of them contains 
a spanning tree, we prove by contradiction that the expected total consensus error will approach to zero 
asymptotically. Therefore, the mean square consensus and the strong consensus are achieved easily. 

The remainder of this paper is organized as follows. Section 2 contains formulation of the problem. 
Consensus problem under fixed topology is discussed in Section 3. Section 4 generalized the results obtained 
in Section 3 to the case of switching topology. Illustrative examples are presented in Section 5, and Section 
6 gives some concluding remarks. 
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2 Problem formulation 



Consider a multi-agent system consisting of A'' agents, labeled by agents 1, 2, • ■ • ,N. Each agent's dynamics 
is the continuous-time first-order integrator 

x^{t)=u,{t), i^l,2,...,N, (2.1) 

where Xi{t),Ui{t) € M, are the state and control input of agent i. Ui{t) is designed only based on the local 
information of neighbors of agent i. Here, agent j is called a neighbor of agent «, if agent i can receive 
measurement of state of agent j. If agent j is a neighbor of agent i, we may denote this relationship by an 
ordered pair (j, i), called an edge from agent j to agent i. Furthermore, if the agents are viewed as abstract 
nodes, the information exchanging among agents at time t may be modeled as a directed graph (digraph) 
G{t) ^ (TV, £{t)). Here, N = {1, 2, N], while £{t) is the totality of ah the edges at time t. G{t) is called 
the network topology (or topology) of the multi-agent system at time t, while x{t) = [xi{t), ■ ■ ■ ^XNit)^ is 
called the information state of G(t) at time t. The totality of all the neighbors of agent i at time t is denoted 
by Nti- For more about of graph theory, readers may refer to standard textbooks, or to [9, 15] that relate 
to the topic of this paper. 

Let agent j be a neighbor of agent i. In this paper, we model the measurement of state of agent j received 
by agent i by 

yj,{t) = W + ^n\xj{t) - x,{t)\^j,{t), (2.2) 

where S^ji = {S,ji{t),t > 0}, i = 1,2, ...,N,j G J\fu, are standard white noises, aji > 0. By (2.2), when 
j ~ h yii{t) = Xi{t), which indicates that agent i can measure its state Xi{t) exactly. A group of controls 
{ui,i = 1,2,...,N} = u is called an admissible distributed protocol, if Ui{t) is measurable with respect to 
the cr-algebra generated by {xi{s),yjt{s), j G A/'si,0 < s <t), i.e., Ui{t) G a{xi{s),yji{s), j G Afsi,0 < s <t). 
The so-called consensus seeking problem is to design an admissible distributed protocol, such that the states 
of all the agents asymptotically approach a common value in some sense. If the convergence is in the mean 
square sense (almost sure sense, respectively), we call the multi-agent system achieves mean square (strong) 
consensus, and the corresponding protocol is called a mean square (strong) distributed protocol. 

For (2.1), a known protocol is 

u,it)=a J2 {V'dt) - ^ (2-3) 

i = 1,2, ■.■,N, which is very popular in the noise-free case (i.e., yji{t) = Xj{t)). In (2.3), \i Mu ~ 0, Ui{t) 
is viewed as 0. In this paper, protocol (2.3) with yji{t) given by (2.2) is also taken. Here, a is called the 
consensus gain, which will be determined below. To ease the following analysis, the adjacency matrix A{t) 
of G(t) is introduced: for any i,j G M, the element aji{t) of A{t) is equal to 1 if and only if (j, i) G Nu, 
otherwise, a.ji{t) = 0. By (2.1)(2.2)(2.3), we have 

x,{t) = a X! aj,{t){xj{t) - x,{t)) + aj,{t)(jj,\xj{t) ~ x,{t)\ij,{t), i = 1,2,..., N, (2.4) 

where the fact that aji{t) = if ^ Mu is used. Now, define a matrix E(t) G M^^^ , whose i-th line is 
given by (0, .., 0, aii{t)uii, a2i{t)u2i, aNi{t)aNi,0, ...0) with aii{t)aii being the {{i — 1)N + l)-th element. 
Let yi{t) = diag(|a;i(i) - Xi{t)\, \x2{t) - Xi{t)\, \xN{t) - Xi{t)\), y{t) = diag(yi(<), y2(i), ...,2/jv(0)- Denote 
= [^uit),^2r{t), ■■■,^m{t)f, and C(<) = [(CiW)^, i^N{t)Vf. The vector form of (2.4) is 

x{t) = -aL{t)x{t) + aJ:{t)y{t)^{t), (2.5) 

where L{t) is the Laplacian matrix of G{t). This is a random differential equation. By classic stochastic 
analysis theory, it makes sense to consider the integral form of (2.5) in the Ito sense 

x{t)^x{0)~[ aL{s)x{s)ds+ [ aJ:{s)y{s)dW{s), 
Jo Jo 
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i.e., 



dx{t) = -aL{t)x{t)dt + aY.{t)y{t)dW {t) , (2.6) 

where {W(t)^t > 0} is the R''^ -valued standard Browniaii motion defined on a probability space (17, J^, P). 
Notice that the covariance of the noise term is a'^J^{t)y{t){J^{t)y{t))'^ , which may be degenerate. Therefore, 
(2.6) may be a singular stochastic differential equation. 



3 Networks with Fixed Topology 

In this section, we deal with the case that the network topology G{t) is fixed, i.e., G{t) = G, for some digraph 
G = {Af,£). Therefore, in this case, the closed- loop system is 

dx{t) = -aLx{t)dt + ai:y{t)dW{t). (3.1) 

To this end, we need the following assumption. 
(Al). The digraph G contains a spanning tree. 

Note that —L may be interpreted as the generator of a continuous time Markov chain with state space 
being Af. Therefore, some standard results on Markov chain can be used to simplified our analysis. To be 
exact, by results in [10], there exists a nonsingular matrix $ = (l^r, $2) such that 

and L e M(JV-i)x(Ar-i) Hurwitz, where Iat is a column vector with all N entries being 1, $2 is a x (A^— 1) 
matrix. Clearly, there exists a positive definite matrix Q such that 

QL + L^Q^~In-i. (3.3) 

In addition, has the following form 

.-1 C ^ 



where \l/2 is a {N — 1) x N matrix and tt is the unique invariant probability measure of the Markov chain 
with respect to the generator -L. Let z{t) = '^-^x{t) = [^^(t), z(i)'^]'^, where z'^{t) G R,z{t) G R^'^. Thus 

x{t) ^ ^z{t) ^ z^{t)lN + <i>2z{t). (3.5) 

Equivalently, Xi{t) = z^{t) + 4>iz{t), where 0i is the ith row of $2- Clearly, \xi{t) — Xj{t)\ = 1(0^ — (l)j)z{t)\. 
Therefore, y{t) is a simple function of z{t). It is worth noting that z^(t) does not appear in this equality. 
Upon the above notations, (3.1) is equivalent to 

dz^{t)^ap{z{t))dW{f), 

dI{t)^aLl{t)dt + aY.{l{t))dW(t), ^ ' ' 

where ^^^T,y{t) ~ ( ) = f ) • known results about the estimation of the solution to 



*2Sy(i) J - \ I](z(t)) 
SDE, sec, for example, [17], for any t > and m > 1, there exists a constant Ct^m, such that 

£;[z(s)|2™ <ct,™(l + £;[z(0)[2")e^'-*, 0<s<t. (3.7) 
Before stating the main result of this section, we recall the following notion ([14] [34]). 
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Definition 3.1 Let [a, fe] be a subinterval o/M. A function f : [a,b] ^ R is called absolutely continuous, if 
for any e > 0, there exists a S > such that for any finite sequence of pairwise disjoint subintervals [ak^bk) 
of [a, b] satisfies '^i^{bk — ak) < 5 then 

El/(M-/K)l<e- 



For any absolutely continuous functions /, it has bounded variation, and thus is differentiable almost 
everywhere (a.e.) with respect to Lebesgue measure. In addition to this, we also have the following two 
results ([14] [34]). 



Lemma 3.1 Let f{t) be a absolutely continuous function on [a,b], and -^^t ~ 0; a.e., then fit) = c for 
some c. 



Lemma 3.2 The Newton-Leibniz formula 

f{t2)-f{ti)= r g{s)ds 
Jtl 

works if and only if f(t) is absolutely continuous, and g{t) — a.e.. 

Note that Lemma 3.2 is a generalization of the classical Newton-Leibniz formula when g is continuous. 



Theorem 3.1 Let a 



with [4'^Q^2]ii being the {i,i)-th element of matrix 



^2Q^2- Under assumption (Al), if the consensus gain a is selected such that Q < a < a, then distributed 
protocol (2.3) is a mean square protocol, and the convergence of states of agents to the common value is 
exponential with rate ^ where XmaxiQ) is the maximum eigenvalue of Q. 



Proof. Let V{t) = {t)Qz{i). By Ito's formula, we have 



dV{t) = 



-a\z{t)\'^ + a^Tr 



Qnm){nm)) 



dt + 2aI{tfQY.{z{t))dW{t), 



By (3.7), we know that 2az{s)^ QYj{z{s))dW {s) is a martingale. Therefore, we have 



EV{t) = V{Q) + E 
Jo 



'a\z{s)\^ + a'^Tr 



gi](I(s))(s](z(s)))^ 



ds. 



(3.8) 



(3.9) 



From Lemma 3.2, we know that EV{t) is absolutely continuous, and for a.e. t >0 



dEV(t) 
di 



E 



-a|z(t)|^ + a^Tr 



QE(?(i)) E(I(t)) 



Notice that 



(3.10) 



N IV 

{Ey{t)){J:y{t)f = diag | ^ (a,i(Oa,i[x,(0 - xi{t)\f , ^ (a,jv(0'Tjw[xj(0 - XN{t)\f | , 



which is a diagonal matrix. Simple calculation shows that 
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Tr 



N 
N 

< (E[*I^0*2]., E {<TJ^\<|>,-<|>^\)A mt)\'^C,m\'. (3.11) 



Therefore, if the consensus gain a is selected such that 



equivalently, 



7i = a — cio^ > 0, 



0<a< — = a, (3.12) 

Cl 



then we have for a.e. t>0 

dEVjt) 
Jt 

Clearly, we have 



< -jiEVit). (3.13) 



From Lemma 3.1, we know that the solution EV{t) satisfies e'^^^EV{t) < V{0) for all t >0, i.e., 

EV{t) < F(0)e"''i*, t > 0. 

Therefore, 

E\I{t)\'^ < C2e-^'\ (3.15) 

for some c-z > 0. Clearly, lim(^.oo E\z{t)\'^ = 0. 
On the other hand, by (3.6) , 

z^{t)^z\0)+[ al3ms))dW{s). (3.16) 
Jo 

By (3.15)(3.16), it follows that 

rt \ 

/•OO 

(3.17) 



sn^E\z\t)Y < 2s\xp[E\z\Qi)Y + E\ al3{z{s))dW{s)\ 
t>0 t>o V Jo 

/>oo 

< 2£:|zi(0)p + 2ci / i;|z(s)p(it < oo, 
Jo 



for some positive constant ci. By Lyapunov inequality, supj>o E\z^{t)\ must be bounded. Due to martingale 
convergence theorem [17], it follows that as < -> oo, z^(i) will converge almost surely to 

z* = z^{Q) + / al3{I{s))dW{s) = 7ra;(0) + / al3{z{s))dW{s). 



In addition, by (3.15), we have there exists a positive number ci such that 

/oo 
£:|J(s)pds < cie-Ti*, (3.18) 

which imphcs z^{t) converges exponentially to z* in mean square sense. Therefore, by (3.5)(3.15)(3.18), 
there exists a positive number C3 such that 



E\x{t) ~ z*1n\^ < 2{E\z\t)lN - z*lNf +E\<!>2z{t)\^) <C3e- 



■71* 



Therefore, we conclude that the distributed protocol (2.3) is a mean square consensus protocol, and the 
convergence of states of agents to the common value is exponential with rate 71 = "g-^ . This completes 
the proof. □ 

To derive the strong consensus result, we need the following lemma. Firstly, Denote 
{Z — s>} = {w G : lim Z{t,u!) exists and is finite}, 

and Z(oo) ~ limt_j.oo Z(t,uj), u G {Z — >}. The following lemma can be found in [18]. 

Lemma 3.3 Let Ai and A2 be nondecreasing processes, and let Z he a nonnegative semimartingale with 
E{Z) < 00 and 

Z{t) ^ Z{0) + Ai{t) - A2{t) + M{t), t > 0, 
where M is a local martingale. Then 

{uj : Ai{oo) < 00} C {Z ^} n {uj : ^2(00) < 00}. 

By Theorem 3.1, we know that EV{t) will approach to asymptotically, while Lemma 3.3 says that V{t) 
converges, a.s., to a random variable. By the subsequence method, we may prove that V{t) converges, a.s., 
to 0, and thus the strong consensus achieves. Therefore, we have the following theorem. 

Theorem 3.2 Under the conditions of Theorem 3.1, the distributed protocol (2.3) is a strong consensus 
protocol. 

Proof. Firstly, by Chebyshev's inequality, it follows that P{\V{t) - 0| > e) P{V{t) > e) < As 
limt^oo EV{t) = 0, we have that V{t) converges to in probability. Therefore, there exists a sequence of 
time {tn, n = 1,2, 3, ...} such that 14„ converges to almost surely. On the other hand, by (3.8), (3.12) and 
Lemma 3.3, we assert that there exists a random variable V* > such that limt_j.oo = V* 1 a-S.. By 
these facts, we can conclude that V* must equal to 0, a.s., which implies that limt_>oo z{t) = 0, a.s.. By the 
analysis of Theorem 3.1, z^{t) converges to z* a.s.. Therefore, by (3.5), we can conclude that protocol (2.3) 
is a strong consensus protocol. This completes the proof. □ 

Now, let us consider the average consensus problem. The following definition can be found in [15]. 

Definition 3.2 A distributed protocol u is called an asymptotic unbiased mean square (strong, respectively) 
average consensus protocol if this protocol is a mean square (strong) consensus protocol, and in addition, the 
corresponding group decision value x* satisfies the following properties: Ex* ~ jj X)i=i 2;i(0), Var{x*) < 00. 

By Theorem 3.1 and Theorem 3.2, we need only to show z* satisfies Ez* = J2iLi a-^d Var{z*) < 
00. The following result is clear. 

Corollary 3.1 Under the conditions of Theorem 3.1 and that the digraph G is balanced, then the distributed 
protocol (2.3) is an asymptotic unbiased mean square (strong, respectively) average consensus protocol. 
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Proof. By (3.18), we have that the expectation of z* is 



and the variance of z* is 



N 

Ez* =Trx{0) =^TriX^{0), (3.19) 
1=1 



Var{z*) I aP{z{s))dW{s) ] < oo. 



Therefore, by definition of asymptotic unbiased mean square (strong, respectively) average consensus, we 
need only to validate that tt = jj-ljf- Notice that ttL = and X]i=i ^« = 1- Clearly, by Theorem 6 of [23], 
iJ^L = is equivalent to digraph G is balanced. Therefore, if digraph G is balanced and by the uniqueness 
of the invariant probability measure of the Markov chain associated with generator — L, we must have that 
TT = -^1^. This completes the proof. □ 

The balancedness of digraph G is quite standard in deterministic average consensus problem, see for 
example [23]. On the other hand, we notice that the above mentioned consensus properties are all global 
notions, as the initial values of states of agents may vary in the whole space of M^. In some sense, this 
suggests that the balancedness property is necessary to obtain the "global" average consensus results. In 
fact, it is easy to show that "local" average consensus results may also be derived even if the balancedness 
property is not satisfied. It is interesting that this phenomenan has been hardly discussed even in literatures 
about deterministic average consensus problem. We give a simple description about this here. Clearly, to 
achieve the average consensus, by (3.19), the following is necessary 



TV ^ N 



1=1 

Equivalcntly, 

(^1 - ^)xm + • ■ • + (ttat - ^)x^(O) = 0. (3.20) 

Let K = lliTi — 7^ : i = 1, 2, A^}|, i.e., the number of elements in {iTi — 7^ : i ~ 1,2,...,A^}. 
Clearly, k = 0, 2, 3, N, by X]il=i ""i = 1- n = corresponds to Corollary 3.1. For k > 2, without loss of 
generality, we assume that tt^ — 7^ 0, i = 1, 2, k. Thus, by (3.20), we have 

(^1 - ^)xi(O) + . . . + (tt. - ^)^-(O) = 0- (3-21) 

Its solvable subspace is denoted by Vi, whose dimension is clearly k—1. Therefore, for any x(0) e Vi ©i?^"", 
the closed loop system (3.1) will achieve the mean square and strong average consensus. It is worth pointing 
out that the dimension of Vi ® R^^'^ is - 1. 



4 Networks with Switching Topology 

In this section, we extend results of last section to the case that the network topology G{t) of multi-agent 
systems is time-varying. The dependence of G(t) on t may be characterized by the switching signal a{t) in 
the meaning that if a{t) = fc, G{t) = Ga-{t) = G^''\ k = 1,2, ...T*. Here, the set of all possible digraphs is 
{G'^''\k = l,2,...,r*}. Therefore, the neighborhood of each node may vary with time. At any time t > 0, 
we can divide the nodes into two classes. On class is the isolated nodes denoted by J\f^{t). The other class is 
denoted by J\f°'{t). For any node in A/'''(i), either it has at least one neighbor, or it is a neighbor of node in 
A^"(t). In the following, we call nodes in M"'{t) to be active at time t. The active nodes with corresponding 
edges of G{t) constructs a subgraph of G{t), which is denoted by G°'{t). While G^{t) denotes the graph 
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composed by the isolated nodes of G{t). Therefore, digraph G{t) may be viewed as the non-intersecting 
union of G°'{t) and G"'(t). Here, by the union of a cohcction of graphs, we mean the graph whose nodes and 
edges set arc the unions of nodes and edge sets of the graphs in the coUcction. Similarly, we can define G^*^)", 
TVC^)", and G'('=)^ A/'^'^^", k = l,...,r*. By (2.3) and (2.1), through rearranging x(t), we get the following 
closed loop system in vector form 

J dx^it) ^ -aL''{t)x''{t)dt + aJ:''{t)y''{t)dW''{t), 

\i^(0 = o, ^'^■^> 

where, x"' {t) , L°- (t) , a"" (t) , T,"- , y'^ (t) , (t) correspond to subgraph G^{t), and .T^(i) corresponds to G*(t). 
Clearly, when a(t) = k, the dimension of x'^{t) is |G''^'-'°|. 

To see the consensus of the agents, consider an infinite sequence of nonempty, bounded and contiguous 
interval [tr,tr+i),T = 0,1,..., starting at to = with tr+i — < T, T > 0. Suppose that during each 
interval [ti-iir+i), tri— ^T),^r' ■••i^™^ the switching instances of (j{t), i.e., the points of discontinuity of 
(t(<), satisfying max{t^+^ — t\., tr+i — } > f, f > 0, Z = 0, 1, ttt-t- — 1. To facilitate the the following 
analysis, we relabel i^+i as To this end, we need the following assumption. 

(A2). For any = 1, 2, the union of digraph {G{t), tk < t < tk+i} contains a spanning tree. 

Define the class of symmetric matrices: Vn = {D\D e R^^^ ,D > 0,Null(D) = spanjlAr}}. Clearly, for 
any Di,D2 S I'jv,/3i,/32 > 0, piDi + I52D2 £ Vn- Notice the following properties. 

(PI). For any D > 0, a; G Nul^D) if and only if x'^ Dx = 0. 

(P2). Let Di,D2 e Vn, then there exists c*,c** > such that c*D2 < Di < c**D2. 

Clearly, (PI) can be derived by simple linear algebra knowledge. In fact, (P2) has been already presented 
implicitly in [9][11], and used in [11]. For the sake of completeness, a brief discussion about (P2) is given here. 
For any nonzero a; G R^, define y = |f|i'^i = {x '■ \x\ ^l},9 = -^Iat, = Bi\{6}, Ai = max^^ge* x'^Dix, 
A2 = miiix^B' x^ D2X. Then x^Dix = \x\'^y'^Diy < Ai|a;p < j^X2\x\^ < j^x^D2X. Therefore, we may 
select c** as j^. c* can be similarly constructed. 

Clearly, the same edge (j, i) may be present in some of GC^), /e = 1, 2, T*. Denote the number of G^^') 
that the edge (j, i) is present in G^*^-* , = 1, 2, T* , by e^i, and let e = max^j- eji. Clearly, e > 1. Then we 
have the following result. 

Lemma 4.1 Let U = i Ef=i l^j - x^\^ P^"'^ - 5 E^gatc-). Ej^j^w^ \x,~x,\\k^ 1,2,...,T*. Then 
the union of {G'^^\ fc = 1, 2, T*} contains a spanning tree if and only if the following is satisfied 

T* 

c*[/<^pW, (4.2) 

k=l 

where c* > 0. In addition, the "only if " part can be strengthened to 

T* 

cU <^P^'''^ <ec**U, (4.3) 

where c*,c** are given in (P2). 

Proof. Necessity. Denote the union of {G*-*^-*, k — 1,2, T*} by G". A simple calculation shows that 

k=l ieN'iG^) jeAf{G")i k=l 

where Af{G^) denotes the nodes set of G", J\f{G"')i is the neighborhood of node i in G". Because G" contains 
a spanning tree, every one in {xi,i = 1,2,...,A'^} will appear in P". By the special structure of P", we have 
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that P" = if and only if [xi, xjv]"^ = x G spanjlAr}. On the other hand, as P" is a quadratic form, 
there exists H >0 such that P" = x'^Hx. By (PI), Nun(iJ) = span{l7v}, and thus H e Vn- As U = x'^Sx 
with S = iV/w - IatI^^ e Pat, by property (P2) and (4.4), (4.2) and (4.3) are followed with c* = c*. 

Sufficiency. Define such that P" = x'^TJa;. Clearly, > 0. By (4.2), -P^''^ = implies that 

U = 0, and thus x G spanjlAr}. By property (PI), H must be in Vjy. Now, we show that G" contains a 
spanning tree. This is proved by contradiction. Assume that G" does not contain a spanning tree. Without 
loss of generality, suppose that G" contains two non- intersecting subgraphs G"^ and G"^, both of which 
contain a spanning tree. Therefore, 

P" = x'^Hx = + x^^^^ H^x^^^ , (4.5) 

where {x'-^', i/i}, and {x'-^\iJ2} correspond to G"^ and G"^, respectively; in addition, x'-^^"^ = (a;'-^^)"'", 
2;(2)T — j^^(2)^T^ Selecting x^"^^ = c*i1|a/'(g')|' ^^"^^ — c*21|a/'(G")| with c*i ^ c*2, we can assert that the right 
side of (4.5) is equal to zero. This contradicts that Null(i/) = span(ljv) by (Pl). Therefore, G" must contain 
a spanning tree. This completes the proof. □ 

Theorem 4.1 Under assumption (A2), if for every k = l,2,...,r*, G^'^-' is balanced, and < a < a with 



N 



5", then the distributed protocol (2.3) is a mean square and strong consensus protocol. 



(iV-l) maxi^j crfj. 

Proof. Let U{t) ^ ^J^Zi E^i l^jit) - Xrit)\'^. Clearly, U{t) = x'^(t)Sx{t), with S = NIn - IatI^. As 
G'^^\k^ 1,2, ...,T*, are balanced, we have 

^W^^ E E k,(i)-^.WP = |^"^WPni)+^ni)-2A''(i))xni)=.T'^^(0i'^(i)2:''(i), 

where x(i)'''^ denotes (x"(t))^, /^'^(t) and D°-{t) are the in-degree and out-degree matrices of G'^{t), and 
thus of G{t). As f/(i) = [{x^it))^ (x"(i))^]S'[(x°(t))^ (x''(t))'^]'^, by Ito's formula, we have 

dU{t) = [-2Nax{tY'^L''{t)x''{t) + a^Tr (5"^(i)(S]''(t)y''(t))(S°(t)?/"(i))^)] dt 

+2ax{t)'''^S''(t)j:''{t)y''{t)dW''{t), (4.6) 

where S"'(t) = A^/|Ara(t)| - llAA-C*)! l|^a(4)| > 0, and the properties that lj^a(t)|i''(0 = 0, L°(t)l|7v-a(t)| = 
are used for several times. Clearly, y°'{t) is composed of elements with form \xj{t) ~ Xi{t)\, where agent j is 
a neighbor of agent i at time t. A simple calculation shows that 



2 



Tr{S'^m^^it)y^t)){^^t)y^it)f)^ ^ [S'^{t)U (cT,,|x,(t) - x,(i)|) 
<2(7V-l)max4.i ^ ^ |xj(i) - ^c,(t)p 

^ C4P(t), (4.7) 
where [5"^ (<)],; = - 1. Therefore, 

U{t)<U{Q)- [ {2Na^Cia^)P{s)ds+ [ 2a(x°(s))^S'°(s)E"(s)y''(s)rfTy°(s). (4.8) 
Select a such that 

72 = 2Na ~ c^a^ > 0, 

i.e., 

2A^ 

< a < = a. (4.9) 

C4 
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By (3.7); J* 2a{x°-{s))'^ S°'{s)T,°'{s)y{s)°-dW'^{s) is a martingale. By similar analysis to that of Theorem 3.1, 
wc have that EU{t) is difFcrcntiable a.e. with respect to t, and 

< -l2EP{t) < 0. (4.10) 

Therefore, EU (t) converges, and denote the limitation of EU (t) by U. Wc will show that U — 0. And this 
is proved by contradiction. Assume that U > 0. Define 

P^''Ht)^l E E \xjit)^x.it)\\ k = l,2,...,T*. 
By assumption (A2) and Lemma 4.1, we have 

T* 



^EP^^\t) > c,EU{t), > 0. 



k=l 

Therefore, 



\\m,^EP^^\t) >cM>0, 
fc=i 

which implies that for some k* £ {1, 2, T*}, 

lim£;p('^*)(t)>^. 



Thus, there exists Ti > such that 



EP^'^'\t)>^, t>T,. (4.11) 

ii j-i+i 



By assumption (A2), wc know that there exists a subinterval [t[.,r^_f^) of [tT-,tr+i),T = 1, 2, during which 

r+l 



G{t) EE G*-'*. On this subinterval (4.10), it follows that 



Clearly, there exists tt-^, such that t^^^ > Ti. Combining (4.11)(4.12), we have that for t > i^-^^ , 

EU{t) < EUt^ < EUt^_, ~ f ■ 72^^ < . • . < EUt^^^ - (r - ttJt ■ 72^, (4.13) 



where r is the largest integer such that t > tr- In (4.13), the inequality 

EUt^ < EUt^_, - f ^ -i2EP*{s)ds < EUt^_, - 72f 



is used iteratively. Letting t — cx) in (4.13), we have that Muit^oo EU{t) = —00. This contradicts that 
EU{t) > 0. Therefore, we have that 

lim EU{t) 0, (4.14) 

i.e., 

lim E\x:jit) -x,it)\^ =0, ij = l,2,...,iV. 



11 



Notice that 



I.e., 



= l^x(O) + / al^^^^.^J:^{s)y^s)dW%s). (4.15) 
Jo 

Similar to (4.7), wc have that 

(l^(,)„|S"(s)y"(s))^lf^(,)„|E°(s)y"(s) < c,P{s), (4.16) 
for some C5 > 0. On the other hand, by (4.10), it fohows that 

72 / EP{s)ds < EU{0) - EU{oo), (4.17) 
Jo 

where EU (oo) = hmt_i.oo EU{t) = 0. Therefore, 

sup E\l§^x{t)\'^ < oo. 



t>o 

By similar analysis to that of Theorem 3.1, l'j^x{t) converges to l^x(oo) almost surely and in the sense of 
mean square, where l^x(oo) is defined as 

/>oo 

llx{^) - llx{Q) + / al^(,)„|E"(s)y'^(s)dTy°(s). 
Jo 

Therefore, by the fact 

\Mt) - < 2|x-,(t) - ^llxit)f + 2\^llxit) - l^llxioo)\\ 

we can conclude that Xi{t) converges to -^l^a;(cxD) in the sense of mean square, for any i ~ 1,2, N. 

Similar to Theorem 3.2, we can easily prove that (2.3) is a strong consensus protocol. And the proof is 
omitted here. □ 

Corollary 4.1 Under the conditions of Theorem 4-1, the protocol (2.3) is an asymptotic unbiased mean 
square (strong, respectively) average consensus protocol. 



Proof. Clearly, 



and the variance is 



E^llxi^) = ^llx{0). 



1 f 

Var{-llx{^)) ^E (lf^(,).|E"(s)y'^(s))^lf^(,)„|I]''(,s)y°(s)ds < oo. 

The conclusion follows easily. □ 

Remark 4.1 // the noises disappear during communication processes, i.e., aji = 0,i,j = 1, .--jN, in (2.2), 
then under protocol (2.3) the closed-loop system is 

x{t) = -aL[t)x{t), (4.18) 

which is the objective of [12], [20], [25], [35]. Comparing to above Theorem ^.1, results in [20], [25], [35] do 
not need the balancedness condition. It should be mentioned that existing results are all based on the fact: 
the explicit solution of (4-18) can be easily expressed. While for the noise-driven case, it is always impossible 
to derive the explicit solution of the closed-loop stochastic differential equation. Therefore, we adopt the 
Lyapunov-based approach to tackle this problem. As a cost, balanceness property of the digraphs is needed. 
For more about Lyapunov-based approach for consensus of agents, readers may refer to [36] and references 
therein. In [36], the authors study the consensus problems in direct networks with nonlinear dynamics. 
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5 Simulation 



Example 5.1 Consider a dynamic network of four agents with fixed topology with Af = {1,2,3,4}, £ = 
{(1,3), (2, 1), (3, 2), (3, 1), (4, 3)}. The quotient digraph is shown in Fig.l. 0-31 = 0-12 = 0-13 = (T23 = 0-34 = 1. 
The consensus gain a is selected as 0.05. For initial states a:;^(0) = l,a;(0)^ — 20,a:;(0)'^ = 50,a:;(0)'* = —5, 
under protocol (2.3), the states of the closed loop system are shown in Fig. 2. From Fig. 2, we can see that 
when t sufficiently large, the common value of the sample path of the agents' states is about 21.21; the 
corresponding mean value is about 17.98; while the average of the initial states of all agents is 16.5. This 
means that the multi-agent system docs not achieve (global) average consensus. However, local average 
consensus may be attained for some the initial values of the states of the agents. By simple computation, 
the TT defined in (3.20) is (0.5,0.25,0.25,0). Therefore, if a;i(0) is equal to 3:4(0), the average consensus can 
be achieved. This is validated by Fig. 3 with initial states xi{0) = — 5,2:2(0) = 20,. 13(0) = 50,X4(0) = —5. 

Example 5.2 Consider a dynamic network of four agents with undirected network topology. The network 
topology are changed as follows: when t ~ [2k, 2k + 1), fc = 0, 1, 2..., it has the structure shown in Fig. 4. (a); 
while when t = [2k + 1, 2fc + 2), fc = 0, 1, 2, it is described by (b) of Fig. 4. Assume that all the a,, are equal 
to 1. a defined in (4.9) is selected to be 2. The initial state x{0) is [1 2 5 — 10]"^. When (2.3) is applied, the 
closed loop states will reach a consensus shown by Fig. 5. 
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Fig. 2. Curves of the states of Example 5.1 
with initial state [1, 20, 50, -5] 
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Fig. 3. Curves of the states' means of Example 5.1 
with initial state [-5, 20, 50, -5] 
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(a) 



(b) 



Fig. 4. The switching topology of Example 5.2 




Fig. 5. Curves of the states of Example 5.2 



This paper considers the consensus problem of first order integrator systems under uncertainty environment. 
The measurement noises are modeled to be multiplicative. For fixed and switching topologies cases, mean 
square and strong consensus are achieved. For further research, consensus problems under measurement 
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noises with leaders are valuable for some applied scenarios. In addition, it is an issue to consider the 
stochastic varying network topology cases. 
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